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ABSTRACT 


An investigation directed at finding the best low-order 
model which approximates a given high-order system is pre- 
sented. New insight 1S gained into the cost paid for the 
Simplicity of the model and in the accuracy of the transient 
response of the model related to the magnitude of a cost 
hanct ion. 

The problem is solved in the time domain by finding the 
best pole and zero locations of the model which minimize a 
defined error criterion. The computer is used to estimate 
these parameters, vila a parameter minimizating program. A 


number of examples are included. 
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I ope LNTRODUCTION 


The process of modeling a given system by a system of 
lower dynamic order can be applied in order to simplify 
systems prior to analysis or to simplify designs. The 
initial design of a complex system is more easily accom- 
plished if we can determinate a low-order model which 
approximates a high-order system and provides useful in- 
formation about the behavior and time-domain response of 
the system. 
Most works on control and simulation theory are per- 
formed on the basis that a mathematical model of the plant 
to be simulated or controlled is known, although this model 
often can be more complicated than is really necessary. 
Simplification of the model seems to be adequate and useful 
in such complex dynamic systems. In the stated problem the 
two major cases are: 
given 1. The measured time-domain transient response of 
a system to a known input driving function, 

or 2. The input-output relation --exact transfer 
function-- or the describing set of differ- 
ential equations of a linear, constant system 
Cftorder n- 

find a linear, constant system of order "m" which best ap- 

proximates the given system. 

A number of mathematical methods and numerical tech- 
niques have been developed and proposed as an approach to 


the solution of the problem in specified and restricted 





cases. All of them present radically different approaches 
but they can be divided into two main groups: one of them 
is to retain specified eigenvalues of the original system 
and to neglect those which do not contribute much to system 
response; the other is based on the estimation of a set of 
_ parameters of differential equations of specified order, 
the response of which approximates that of the original 
system when both have the same driving function as inputs. 

The approximation problem considered by Meier [6] uses 
a quadratic performance index, the mean-square difference 
between the output of the given system and the output of the 
reduced model when a random process is the driving function 
to both systems. Necessary conditions for optimum parameter 
values are calculated by differentiating the performance 
index with respect to the parameters. The approximated 
model is obtained for a specified or chosen suitable value 
of the order "m". 

The Meier and Luenberger's approximation [5] deals with 
the modeling by a system of fixed lower order and leads to 
a set of nonlinear algebraic equations which constitute the 
set of necessary conditions for the optimal approximating 
transfer function which minimizes an integral criterion. 

Both methods require that the exact transfer function 
of the system must be specified and assume a stationary 
random process as input to exact eal approximated systems. 

Kuppurajulu and Elangovan [4] propose a method for re- 


ducing a high-order system to a number of simplified models 






by dividing the total time of response into a number of 
smaller intervals. The reduction is based on retaining 
only those eigenvalues of the system which have dominant 
effect during the time interval of interest. Thus reduced 
models can be obtained for the initial, intermediate and 
final stages of transient response. 

Davidson [8], [9] and Chidambara [9] also propose a 
method based on the retention of specified eigenvalues of 
the original system and they neglect those which are far 
from the jw-axis since they make little contribution to 
the total response, except at the beginning. It uses rela- 
tionships from the time solution of the differential equa- 
tions of the original model in order to develop the reduced 
model. It is a projection method: a projection operator is 
found when the projection error is minimized and then, a 
contraction process is operated for choosing a suitable 
basis of dimension "m" (m<n) and a suitable set of "m" 
variables. 

Anderson's work is along the line of the second group, 
his method determines a reduced model by minimization of 
the mean-square error between the responses of both model 
and original system over a given interval. It uses the 
orthogonal projection theorem to minimize the sum of the 
Square errors at the sampling instants, and the steady- 
state error between both responses is not forced to be zero. 

There are other transfer function methods, as the one 


of Chen and Shich which is based on the continued fraction 





expansion in polynomial form of the transfer function, 
truncating it after geese number of terms. It takes 
into account the fact that the quotients in the expansion 
--by the final value theorem-- are in order of decreasing 
contributions to the response as the steady state is 
approached. 

But in general, all these methods require an exact know- 
ledgment of the system transfer function and this requires 
that in practice we have to identify exactly the system in 
order to know its transfer function or the set of differ- 
ential equations which define it. Unfortunately this is 
seldom achieved. It seems more realistic to use directly 
the measured input-output data for the system and determine 
from it the reduced model for the system. 

Sinha and Pillie [1] present a method with this advan- 
tage based on the use of the matrix pseudoinverse to esti- 
mate the parameters of the model which minimize the sum of 
the squares of the errors between the responses of the sys- 
tem and the model to a given input. It only requires the 
measurements of the input-output data. Sinha and Beraznai 
[3] develop a more general method for any specified error 
criteria of optimization, providing flexibility by the choice 
of the criterion and using pattern search for the optimum 
approximation. This method determines the optimum low-order 
model for a given order of the model (a model of order “m" 


is known, m<n). 





a la ae 


Fellows, Sinha and Wismatch [2] propose a simple method 
Eo —Beducing sashiogn-order ee a second-order model. 

It selects the second-order model, that meets specified per- 
formance features of the step-response and which is a good 
approximation to the step-response of the actual system, 
based on the minimization of the integral of the square 
error criterion. 

As can be seen during recent years methods and techniques 
have been developed and applied to replace a complex system 
by a simpler system, some of them choosing the modes Pee 
discarded in the construction of the new low-order system 
by mathematical techniques and the other ones selecting the 
order "m" (m<n) of the model and calculating the optimum mth 
order system which best fits the original by different 
methods and criteria for the minimization process. 

In this thesis it is intended the search for the best 
model which fits the original by optimization in the time 
domain, or, if not, to answer the question of what will be 
the price which it is necessary to pay for the simplicity 
Of the model if a previously selected order of the model is 
specified or desired. 

Carrying out an exhaustive search and determination of 
all possible low-order models for specific high-order sys- 
tems, hopefully seems feasible to provide a basis for com- 
parison of the results obtained if the complete set of 
resulting data is analyzed and studied in order to establish 
a criterion which can be used for the selection of the model 


in a particular problem. 
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Powerful mathematical tools of optimization theory and 
suitable criterion for an optimum fit in the solution are 
used in the practical search of low-order model systems. 

Two general cases are investigated: 

1. Modeling based on using directly the measured input- 
output data for the system. 

2. Modeling when the exact system transfer function is 
specified. 

In Chapter II of the thesis, a general description and the 
philosophy of the technique for the solution is given, and 
it is applied in Chapter III which is devoted to the study 
of four general examples selected as a guide for initializ- 
ing the investigation in this aspect of the modeling problem. 
This search can be reese of as another approach to the 
determination of low-order models and as an effort directed 


to extend the research done in this sense. 
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Et. TSCuntoun FOR .SoOoLUL Teh 


A. GENERAL 

In dealing with the modeling of high-order systems by 
an optimum low-order model two main cases can be expected: 

1. The measured input-output data for the system is 
known. 

2. The exact system transfer function or vector dif- 
ferential equation are given. 

Some assumptions about the systems have to be made for 
the sake of convenience, although the same assumptions 
underline most of classical control. It is assumed that 
all systems are: linear, constant-coefficient, asymptotically 
stable and single-input and single output. Under these 
assumptions 

a. the linear system will be easier to study than the 
general case. 

b. a second-order system is clearly simpler than a 
fourth-order system. 

c. all poles of the system will lie in the left half 
plane. 

Also the optimum model system is that which minimizes the 
performance index previously selected. 

The dynamic behavior of a second-order system has been 
thoroughly studied and is well known, thus finding a pair 
of complex dominant roots --for the high-order system would 
be equivalent to approximating the system by a second-order 


model. It is known that in design problems of high-order 


dee 





feedback systems by algebraic methods, the designer selects 
a pair of complex root locations and then tries to locate 
two of the roots of the system at these locations and the 
other ones (undeSired roots) at remote points far from the 
jw-axis in the left-hand side of the s-plane. In this way 
the transient response of the system closely follows the 
selected second-order system's response. The "dominant" 
character is achieved if: 

a. the coefficients in the time response associated 
with the desired root are much larger than those associated 
with undesired roots. 

b. the time constants of the undesired roots are much 
smaller than those of the selected pair. 

For physical systems, closed-loop poles are seldom found 
at the origin and complex poles located far from the real 
axils produce oscillations in the time-domain response of a 
higher frequency than those located closer to the real axis. 

In this work it is assumed that the step-response of the 


high-order system has an overshoot at least. 


B. PHILOSOPHY OF APPROACH 

A realistic approach to the derivation of the low-order 
model which better approximates the given high-order system 
is to perform it directly from the known response of the 
system to a specified driven function which may be obtained 
experimentally. If the system is to be operated always with 
a specific input signal, then this @riving function can also 


be used as input of the model for comparison of both 
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responses. A step function as driving function is very 
common in dynamic system test and identification procedures, 
on the other hand, step-function excitation often has the 
important advantage of simplicity. 

Thus, the problem can be restated as the determination 
of the transfer function of the low-order model which is an 
optimum approximation to the step-response of the actual 
high-order system, based on some criterion prooaneace 

It was felt that a convenient approach leading to the 
problem solution is the determination of the 1th optimum 
model (l<n) satisfying some specification of criterion 
rather than the determination of a specific low-order sys- 
tem, 1.e. a second-order model. 

im) celecting the System Response 

A typical time characteristic, acceleration curve 
eee) Of an actually ee dynamic element is shown in 
Fig. II.1. In a general case an acceleration curve consists 
eiea Célay portion of duration £4, a concave portion T), 2 
constant-velocity portion T5, a convex portion T3 and the 
steady-state portion. 

Figure II.2 shows typical unit-numerator step-response 
patterns for systems up to sixth order. 

If the step-response of a system takes the form 
Shown in Fig. I1.3, it can often be approximated as a time 
delay plus the response of a second-order system with two 


complex roots. 
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The common characteristic in the above step-responses 
Meme time delay ty. Very often in the study of practical 
high-order systems, this concept of introducing a pure time 
delay to account for the higher order permits interpretation 
and study of the step response in terms of relative stability 
and the nature of the corresponding frequency response. 

Therefore, the high-order system eons to a step 
input-function was selected as a pure time delay plus the 
response of a second-order system. The results in EXAMPLES 
I and II were obtained working with this assumed typical 
high-order system response. 

2. Statement of the Problem 
Let the given nth_order linear, time invariant sys- 


tem be described by 
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xt) = AUBEGE Seer (t) 5 00) p= 0 
ViGE) ee Casati) (Tepes) 
For the single-input case considered 
x(t)"= Agee + Ber(t) =;  «(0) = 0 
yitey"=9 Ci Ce) (fee) 


mere X(t) 1s the n=dinensrenal State™vector aiid the “dot” 
Over a variable is used to indicate the time derivative 
(d/jdt). Ais a"“n xn" matrix, B is aa n-vector and r(t) 
is the ae tee function representing the input to the 
system (step-function). C is the n-vector and y(t) is the 
output of the system. 

Consider a discrete set of values of y(t) taken over 
a Suitable interval of time 

Y = {yo, Yyr Yoreeees poe ce ernie ren (II. 3) 

Yi = y(t) 
Which represents samples of the response of the system de- 
scribed by Eq. (II.2) to a step-function input. It may have 
been obtained by a measuring instrument connected to the 
actual system output with a sampling interval sufficiently 
small in order that no information be lost. 

It is desired to find the best low-order model de- 


scribed by 


x = 1 ee +SEE rGe) > x,(0) = 0 (II. 4) 


Yr = Gr X 
Eeose set of olltput samples Y, satisies the condition of 


minimizing an error function J(a) given by 
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oe (ye = yew) (an, 5)) 
mere Q represents the N.~vector of the free model parameters. 
3. Error Funceron Cemeeria 
The mean-square criterion was chosen as the function 
femene errors (y--y-,). This performance index is suitable 


for many minimization problems and takes the form 
NF 
J(a) = 2X wy (yi - Yri)? (Te 6) 
O 


lere Ne 1S a positive integer defined as 


Final time of the calculations te 
Ne = = See Chive) 
Sampling period T 





and w; is a weighting sequence which for the single-output 
case --assumed in this work-- is unity. 

When (J) is minimized with respect to the free low- 
order model parameters in the bounded region defined by the 
constraints, the optimum values of the free parameters are 
found. Since one free parameter exactly locates one root 
of the model, when the error criteria is minimized the set 
of optimum parameters locate all the roots and the transfer 
function of the optimum model is determined. 

The error criterion in the form 

tf 

J (a) — (ys - yyy) 2dt (72.8) 
depends on tg, but once ty, is chosen long enough and fixed, 
it does not affect the optimum parameter values obtained at 
the end of the minimization process. tr, was chosen as the 
settling time of the time-domain response of the high-order 
system. 


is 





C. METHOD OF SEARCH FOR BEST MODEL 
is) Bhnlosphy, 

The problem of approximating the high-order system 
by a low-order model in an optimum manner was solved for the 
Specified error criterion (see Chapter (II.B.3)). 

For the general 1th-model (Eq. II.4) the closed loop 


meansiter function can be written as 








Yes) bce es Dee Feeseees --t by S + bo 
a) = ——— — (II .9) 
Rs) sh ae elo ae Date eeds <6) seeps. 6. oe a, § + aq 
Or 
K(st+zZ 1) (stZ9) ...--. ieee St Zim) 
G, (s) = Gil . 10) 
(stp,) (stpo) hn vege ee eee (Stpy) 


which is a function of the transfer gain and pole-zero con- 
figuration, which are the free parameters of the model. 
Assume a‘ complex system presenting a step-response 


which may have an overshoot. Then Eq. (II.10) may be 





modified 
K(s+z1) (stZ5)...-. ae eS (stz.,) 

G,.(s) _ (ciples d. 1) 
(s?+20,0,sta$) (stp3)....(stpy) 

where 


PytPg = 20,4, 

PIP) = a2 
and p;>0 (no pole at origin) 

This low-order model is characterized and defined by 
a set of free independent parameters which can be chosen 
based on a specified error function criterion in order to 


Optimize it. For given values of the pair "1" and "m" 


Re) 








a | i 


(m>l>n) the optimum ith_order model which minimizes the 
error criteria 1S realized by an optimum choice of the free 
parameters. It 1s reasonable to expect the value of the 
error criteria between the responses of the actual system 
and the model, for each one of them, will decrease as the 
order of the model is increased. If a 3-dimensional param- 
eter space is considered with coordinates axis 

XX' : number of zeros of the model 

YY' : number of poles of the model 

ZZ' : values of the error criteria for optimum model 
for a specific value of the transfer gain, the set of error 
criteria values for the multiples choices of both number of 
zeros and poles will be represented by a surface. Hopefully 
a minimum to this eacey if it exists, would represent the 
minimum of all minimum error values, in other words, it 
would define the "best" of all optimum low-order models for 
a specific value of the transfer gain. 

The decision in the choice of the lower order ap- 
proximated model which better represents the given system, 
if there is not a net minimum, can be done taking into 
account available criterion such as: limitations on the 
maximum order of the model because the limitations on the 
available model components, or sufficiency of the resultant 
error criterion (J) which satisfies the inequality 

Dt eae a 2 0 
where Jq is a minimum boundary --decision criterion-- for 


the error criteria (J). In this way, having plotted the 
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error criteria versus a specified number of poles and zeros 
it will be easy to decide which model accomplishes the de- 
cision criterion or which one is the best among all the low- 
order models not satisfying it. 

Starting with a model with poles only (no zeros) the 
optimum set of parameters can be determined for the second- 
order model satisfying the selected error criteria, the 
order is then increased by one and a third-order model is 
determined in the same way, and so on. Plotting the results 
will show the variations of the error value with respect 
to the order of optimum models. Continuing with a model with 
one zero, the same search is performed increasing the number 
of poles by one. Then select models with two, three,.. 
zeros and for all of them, again, the optimum models with 
increasing number of poles are determined. The family of 
curves obtained are the major decision tool in the deter- 
Mination of the optimum low-order models. 

2. Constraints 

In order to get the optimum low-order system's trans- 
fer function it is necessary to find the optimum value of 
the transfer function gain, K, and the best locations of 
zeros and poles for the optimum model. Thus the number of 
free independent parameters at least is equal to mt&+l1, 
where 

m : number of zeros of the model 
: number of poles of the model 


Ks tfanerer fEunetion gain 


Za 





As was stated in paragraph I1.B.4, a 3-dimension 
parameter space is considered for representing the varia- 
tions of the error criteria as a function of both number 
of zeros and poles. 

In setting up constraints on the minimization process 
the transfer function gain may be kept constant or it may be 
allowed to vary as one of the parameters. If it is variable 
then a 4-dimensional space is needed. This not only makes 
it hard to find the minimum of the surface, but the concept 
of a varying gain is not consistent with most physical 
problems --at least not for control systems. Therefore in 
this study the gain is kept constant. 

In practical systems the Body gain, i.e., the trans- 
fer function gain when written in Bode form, usually is 
fixed by specifications. In many applications it corre- 
sponds to the DC gain or zero frequency gain. If the 
Mmeamster function is left in Root Locus form, i.e. (stz)/ 
(stp), the Root Locus gain is a number that varies with 
both the number of zeros and poles, and as such does not 
usually have an apparent relationship with physical system 
performance characteristics. 

Therefore the Body gain is kept constant in the 
search for the minimum, and it is also constrained to be 
positive. 

In order to ensure the Sean li ty of the system the 
pole and zero location is restricted to the Left Hand Plane 


Only, assuming no poles at origin. 





3. Minimization in Parameter Space 

The error criterion or performance index is minimized 
with respect to the free system parameters in the bounded 
parameter space defined by upper and lower boundaries on the 
parameter values and by the constraining inequalities and/or 
equations. When this is done it yields the best zero and 
pole locations for the given lower order model. 

Various search techniques may be considered for the 
minimization process of the specific error criteria. Gradi- 
ent methods are quite efficient in locating a minimun, 
although the necessity of calculating partial derivatives 
of arbitrary error criteria with respect to all the free 
parameters seems to be a disadvantage. Direct search in- 
eee evaluating the effect of sequential parameter changes 
in an organized manner. 

A subroutine for the minimization of an arbitrary 
function by the complex method of M. J. Box [14] was chosen 
aS a suitable method for this work. 

An important problem associated with every search 
technique is the selection of the starting parameter values, 
because of their considerable influence on the convergence 
of the process and on the probability of locating the 
optimum minimum. If the step-response of the high-order 
system has an overshoot it is felt that the determination 
of a second-order system with a pair of conjugate poles 
(dominant roots) will be a good approach for the selection 


of the starting parameter values. From the step-response 
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some features usually can be specified: the maximum over- 
shoot, the steady-state response, the settling time, the 
time to reach the first maximum; therefore, a second-order 
system that meets those specification approximately can be 
determined using the analytical expressions or the universal 
curves for the step-response as a function of the natural 
frequency (w,) and the damping ratio (¢). These approximate 
parameter values are used as starting values for the minimi- 
zation program in order to get the optimum set of parameters 
for the second-order model and successive higher order 
models. 

For the case in which the step-response has no over- 
shoot a simple first order system can be determined by 


K 





G(s) = 
Sip 


ee Oe time required to reach 0.632A. 


'O 
t 


K = A.p , A = steady-state response to unit step. 
for the selection of the starting parameter values in the 
minimization subroutine. 

This thesis considers only step-response with an 


overshoot (more general case for physical systems). 


D. PROGRAMMING 

The performance aay (error criteria) is minimized with 
respect to the free system parameters. 

A subroutine has been used which finds the minimum in 


the given bounded region. 
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At each of the minimization procedure, Eqs.) (ll. 4) sand 
mi.8) are integrated from €-0 to E=t- by eing astourtn] 
order Runge-Kutta method.t The optimum parameter and mini- 
mum error values are taken back to the main program which 
calls another subroutine (SIMUL) for the digital simulation 
of both high-order and low-order systems in order to get a 
graph representation of the time-domain responses and com- 
pare them. 

If at the end of a minimization step the calculated 
parameters, or at least one of them, are on the limiting 
boundaries then the limiting boundary(s) can be relaxed and 
the minimization should be repeated again to obtain optimum 
parameter values for the new boundaries. 

The original high-order system may be specified either 
by its output response to a given input step-function avail- 
able at discrete uniform intervals of time, or by the closed- 
loop transfer function. In the latter case the main program 
computes the transient response at discrete uniform interval, 
stores it in an array "look-up" and the computation con- 
tinues as in the first case. 

The parameter starting values for the model to be used 
in the minimization program have to be given by the user. 


A computational flow chart is shown in Fig. II1.4. 


ItThe increment time for the integration process should 
be equal to the sampling or integration times for the given 
high-order system. 
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ENE Ua: 
Input-output measured 
data of the system. 
N: number of samples. 
DT: sampling interval 


State equations of 
4 the system. | 
[~ N: number of points. 
| DT: integration interval. 










DOT 
Explicit constraints on the 
independent variables. 
Upper and lower bounds. 
Starting point. 


SUBROUTINE BOXPLX: Finds the 
minimum in the given bounded 
region. 










cLFUNCTION KE (xX) : 
Checks for specific 
constraints imposed 
by the user. 

If o.k., set KE=0 
Otherwise set KE= 


[Continue withl {Generate}! 
{the normal | Janother | 
minimization | ypoint 4 
eee FL 


KE=09 toot FUNCTION FE(X,XDATA):  f 
NO “~%% YES Calculates the value of} 
| the error ce terion), 


by 


= 






eg{@eae=z=e Gee ees @ eee @®e@@ & 2B & © & & & 





A minimum is found 
BrpeEinT: a and the value of 
the other necessary variables, 
















Lg- mam Me CO om Me OO 2 S&S @ 


Are the free parameters on the 
preset upper and/or lower 
boundaries? 


= Relax the 
YES boundaries. |?" 


- 


PRINT: "The optimum 
model is :", 

and a, J, other necessary 
information. 


‘Set the new starting 
point at a. 
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Figure II.4. Computational flow-chart. 
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Two computer programs which are written in Fortran IV, 
and used for two specific models of the Examples I and IV 


are given at the end of the thesis. 


Ca 





III. INVESTIGATION AND DERIVATION OF MODELS USING MEASURED 


‘ IN@ST-OUTPRUT eDATA FOR THE SYSTEM 


A. GENERAL 

It was felt that a convenient description of the actual 
high-order system measured input-output data has the form 
shown in Fig. I1I.3, namely a pure time delay plus the re- 
sponse of a second-order system. In this way the output of 
the system is obtained and sampled at suitable time interval 
at) . 

The next step is interpreting the features of the step 
response more commonly specified, in order to select the 
starting parameters for the search of the model (as was 
indicated in Chapter II.3). Then the state equations of 
the possible model are integrated with respect to time with 
a step-input function, and the output of the model is ob- 
tained and sampled at At. These samples are compared with 
the values of the response of the system. An error criteria, 
which measures the deviation of the sampled model values 
from the sampled system values (from zero time to the selected 
Settling time of the system) is defined. Minimization of this 
error criterion with respect to the model parameters yields 
the optimum model, for the given system description, using 
a specific order for the model. 

The starting parameter values were taken as is stated 


ma Chapter Il, Section C.3. 
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B. EXAMPLE I 
The input-output measured data for the testing system 


was taken as the step-response of a second-order system 


with 
r= 0.316 
Wn= (10.)% (poles at: -l. + 33) (area) 
K = 10. 


delayed an interval tg = 0.15 seconds. 

This response was computed by digital simulation from 
0 to 5.2 seconds and 520 samples of this response (at inter- 
vals of 0.01 seconds) were used for the determination of 
optimum 1th_order models by Minimization of the error 
criterion (Section II.B). 

The investigation of possible models was carried out 
starting with 1th_order models (i = 5253 soe 7) Wi Ebene 
zeros, and then repeating the search for models with one 
zero, then with two zeros, ending with models with three 
zeros. It is considered that 7 poles and 3 zeros are a 
good stop criterion for analyzing results. 

As a constraint it is assumed that there is no error 
in steady-state response to a step input, keeping the Bode 
gain constant. 

1. Two Poles No Zeros Model 

a. Model response 
The state equations of the second-order model 


Gan be written as 


Z9 





. 0 1 0 
Ge) eee (a See ate meg 
“P}P2 ~—(PytP,) i 
x, (0) =0 (Eile) 
where u(t) = lie), Meo Ghe State vector of the model 
peep y,P> are the pole locations or free parameters of the 
model. 
The output of the model is 
y(t) = [Kk 0} + x(t) (III. 3) 
where K is the transfer gain. 
Catring soe them)=-caimensional vectOmerepnecenting 
Emestree model parameters (where N,=number of poles + number 


of zeros), the state equations can be rewritten as 


: 0 i ay Of 
Beit) = ° te eu(t) (Lin <4) 
02 = 200 X iL 
se ee 2 
because they are chosen as parameters a, and a5 -- the 


damping ratio and natural frequency. 
b. Constraints 


The only constraining equalities and inequalities 


are 
K/05 = constant = l. 
0<a,<0.5 Cia} 
0<a5<35.5 
as a boundary for the dynamic response. 
c. Result of the minimization 


The Error Criterion 1S Written as 


iE 
J(a) = xz(t¢) - | : ve Pee edt (Cieiyron) 
0 
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where te = Final time of the sampled complex system. 
And its time derivative is 
i) Ce eee elie (III.7) 

The integration is performed with increment time 
At = sampling interval = 0.01 seconds. 

The performance index x5 (a,t) 1S minimized by 
the computer subroutine with respect to the free parameters; 
the optimum parameter values and error criterion minimum 
value are tabulated in Table III.1, and the optimum time 
response of both the original and optimum second-order 
system (for a unit step input) are plotted in Fig. III.5. 

2. Three Poles and no Zeros Model 
a. In all this work it was assumed that the de- 
Sired dynamic response of the model was represented by two 
Gemplex roots and a certain number of real poles and Zeros 
(because of the overshoot of the original system). Thus 
for this case the model transfer function 
ny USE K 


= G(s) = (eure 7) 
U(s) (stp,) (stp 2) (stp3) 








can be written as 


K 
Gas) (III.9) 
= (s*4+2a,a5sta5) (sta3) 





meee the free system parameters vector © is represented by 
O, 


a 
a = 2 and each a; = £(p)+P2/P3): 
3 


SL 





The state equations for the model are written in the 


form 
2 0 a 0 0 
x(t) = 0 0 1 °x_ (t) + 10 Use) (TLE.10) 
“a, ay ~as iL 
and the output of the model is 
y,(t) = E 0 o ee Ce sae )=0 (asi 11) 
where each ay = £ (a4 7A 703) and K is the transfer gain. 


b. In setting constraints, again the Bode gain was 
kept constant'and no error was permitted in steady-state 
response to a step input 


K 


2 
a0, 


= dl. (er. 2) 


The third pole (a3) was constrained to an upper 
bound of 100 and to be positive; flexibility was given in 
the computer program for changing this constraint if the 
upper boundary was reached. The minimization process 
showed that the boundary was not reached. The complex 
conjugate poles were constrained as in Section III.B.1. 

Minimization of the objective function (J) yields 
aS optimum parameter values the result tabulated in Table 
meet and plotted in Fig. III.1. Figure III.6 shows the 
time responses .of both the system and the desired third- 
order model with no zeros. 

3. More Than Three Poles and No Zeros Models 

With the assumption of two complex conjugated roots 

for the model and following the same technique, search and 


determination of optimum models of order ranging from fourth 


SZ 





to seventh was carried out. The resulting optimum param- 
eters and optimum error criteria are tabulated in Table 
III.1, and the minimum error criterion value is plotted 
versus number of poles in Fig. III.1l. 
4. Models With Zeros 
The number of zeros of the model was increased by 


, th 


one and determination of the ~order model (2<%<7) was 


investigated. 


jth 


The state equations of the -order system are 


Mmiettten in the form 


x, (t) = ae) + Be) ; x (0) = 0 Gili. 13) 
where 
0 1 0 
0 0 0 
ay = ° e . 
aay : j ‘ 
~ay aoe seme ~ag 
0 
0 
Pr = [° : u(t) = ie) CT LI) 
1 


and the output of the model is 


Vente es Cex (tC) (EET ES) 
where 
C, =K [by b. areola Cinlles 1G.) 


iene Same way aS in section (2.a) the coefficients a, and 


b- 


meare functions of the free parameters (poles and zeros) of 


the model system. They are expressed as the sum of com- 


binations of products of the free parameters. 


a 





Each model was minimized with respect to the selected 
error criterion (Eq. (III.6)). The final time for the inte- 
gration is taken as the final time sampled Ela seconds). 

Again the starting parameter values were taken from 
the second order model and the boundaries from the same model 
with no zeros. Flexibility was given for changing the upper 
and lower bounds if any of them was reached and the result 
was a constrained minimum. Constant Bode gain and zero error 
between.both steady-state responses were required. 

The resulting free parameter values for each optimum 
medel are tabulated in Tables III.2, III.3 and II1I.4 (and 
the corresponding error criterion values). A plot of the 
cost function (J) versus the number of poles, for constant 
number of zeros, is showed in Figs. III.2, III.3 and III.4. 

Table III.5 is a comparison of the error criterion 
values for all models studied in this example and it shows 
the existance of a best-optimum low-order model. Figs. III.7 
to III.18 show the time response of the system and several 
models. 

5. Remarks 

Looking at the tabulated results in Table III.5, 
which is a resume of the study done with this system and a 
clear basis of comparison between all the models, and at 
the plotted values of the performance index (J) versus 


number of poles, some facts can be clearly pointed out: 
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TABLE III.1. EXAMPLE I. Optimum models without zeros. 
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EXAMPLE I. Optimum models with one zero. 
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TABLE III.3.. EXAMPLE I. Optimum models with two zeros. 





TABLE III.4. EXAMPLE I. Optimum models with three 
zeros. 
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TIME 
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System's response (A) and the Two 
Poles no Zero model's response 
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Figure III.6. EXAMPLE I. System's response (A) and the 


Three Poles no Zero model's re- 
sponse (B) to a unit step input. 
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mrgure IIll.7. 
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EXAMPLE I. System's response (A) and the Five 
Poles no Zero model's response (B) 


Figure III.8. 
EOucawulte "Stem Tinplis. 


42 








or te : ae 4. 


Pigure III.9. EXAMPLE I. System's response (A) and the Six 
Poles no Zero model's response (B) 
to a unit step input. 
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Figure III.10. EXAMPLE .I. System's response (A) and the 
Three Poles and One Zero model's 
response (B) to a unit step input. 
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Pegure III.11l. 
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System's response (A) and the 
Four Poles and One Zero model's 
response (B) to a unit step 
‘Oe. 
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Figure III.12. EXAMPLE I. System's response (A) and the 
Five Poles and One Zero model's 
response (B) to a unit step 
Input. 
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System's response (A) ona the 
Six Poles and One Zero model's 
response (B) to a unit step 
input. 
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megure IIIT.16. EXAMPLE I. eee s response (A) and the 
Six Poles and Two Zeros model's 
vesgponse (8) to a Unit step 
Heyes 
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Figure III.17. EXAMPLE I. System's response (A) and the 
Five Poles and Three Zeros 
model's response (B) to a unit 
step input. 
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Figure III.18. EXAMPLE I. 
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De 6. 


System's response (A) and the 
Seven Poles and Three Zeros 
model's response (B) to a unit 
Step input. 
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a. A best optimum model seems feasible. 

b. The models in the range from four poles to seven 
poles achieve a very acceptable error criterion value. 

c. The second-order model does not seem a very good 
approximation. 

dad. The simplicity of a specific order model can be 
weighted versus criterion error value. 

e. As the order of the model is increased the poles 
go far away on the real axis. On the other hand the error 
criterion value remains almost unchangeable increasing the 
order. Thus it can be thought that adding poles to the 


model is not going to minimize the performance index. 





Peete Fit.5. Error criterion (Ix104) foul megdels iM 
Examp lem. 





C. EXAMPLE II 

The input-output measured data of’ the high-order system 
was taken as the step-response of a second-order system with 
the same features (Eq. (III.1)) as in Example I, delayed an 
interval approximately twice the above tg. Thus, now 


ey 2tq = 0.3 seconds. 


So 





536 samples of ne input-output assumed response (at in- 
tervals of 0.01 sec.) were used as measured data for the 
derivation of the 1th-order optimum models by minimization 
of the performance index defined in Eq. (III.6). 

The investigation was performed using the technique of 
Example I. All possible models were determined of order 
ranging from no zeros and two poles to seven poles and three 
zeros. The optimum pole and zero locations obtained for 
each model are tabulated in Tables III.6 to III.9 and plots 
of the error criteria values versus number of poles are 
shown in Figs. TII.19 and III.20 for specific numbers of 
zeros. 

For further comparison between all models Table III.10 
shows the performance index (error criteria) values for 
each. Figs. III.21 to III.36 show the time responses of 
various models and the original system. 

1. Remarks 

The following comments should be noted: 

a. If 1>k the results show that the optimal model 
of order "1" is better than the optimal model of order “k". 
The error criterion value decrease as the order of the 
model increases, although in any cases the error values 
for the fourth-order model (no zeros) and higher can be 
considered acceptable. 

b. For a specific number of poles, adding a zero 
to the model maintains the cost function value at about the 


Same magnitude. 
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TABLE III.6. EXAMPLE II. Optimum models with no zeros. 





oe © 













pf sta 
vol a) as 
| men! sels 
es 
ee lew 
ie: 


199ms | 219%351) 9788 ae Soo eee ye 12 


fae bE tthe. BxAMeEe Ili. “Opramum medels with one Zero. 


See else |  salbe 
sofa 10.97 


SD 





| 
3 


61.9 
: 16345 


TABLE III.8. EXAMPLE II. Optimum models with two zeros. 








TABLE III.9. EXAMPLE II. Optimum models with three zeros. 
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c. Between one model and the next one (increasing 
the order by adding a pole) the additional pole does not 
affect the initial pole location appreciably. They remain 
approximately the same, and the new pole is set far away to 
the left (in the s-plane). 

ad. The second-order model is the worst. 

e. Selection of the desired model can be done 
easily depending on the desired simplicity, looking at the 
transients responses of both (original and approximated) 
systems and with a little margin for the cost function 
value it can be seen, in this example, that the fourth-order 
model fits very well. 

f. The complex root values for the various models 
remain in a very small area, i.e., their values are 


essentially unchanged by the addition of poles and zeros. 





MABILE IIL.10. Error criterion (Jx104) for models in 
Example II. 


D. EXAMPLE III 
1. General 
A transfer function G(s) of a seventh-order system 


with no finite zeros is given by 


SN, 








Figure III.21. EXAMPLE II. System's response (A) and the 
Two Poles no Zero model's re- 
sponse (B) to a unit step input. 
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Figure III.23. EXAMPLE II. System's response (A) and the 
Four Poles no Zero model's 
response (B) to a unit step 
ee Des 
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Figure III.25. 


EXAMPLE II. 


System's response (A) and the 
Seven Poles no Zero model's 
~wesponse (8) tO -a uUnLle euees 
Mite itters 
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EXAMPLE II. 


System's response (A) and the 
Three Poles and One Zero model's 
response (B) to a unit step 
INPUT 


65 








Ur. iT ea). Si 4. ae 


Figure III.27. EXAMPLE II. System's response (A) and the 
Four Poles and One Zero model's 
response (B) to a unit step 
INOUE. 
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eeoure IfiI.28. EXAMPLE II. System's response (A) and the 
Five Poles and One Zero model's 
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Figure II1I.30. EXAMPLE II. System's response (A) and the 
Seven Poles and One Zero model's 
response (B) to a unit step 
IYO 
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Figure III.31. EXAMPLE II. System's response (A) and the 
Four Poles and Two Zeros model's 
response (B) to a unit step 
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Figure III.32. EXAMPLE II. System's response (A) and the 
Six Poles and Two Zeros model's 


response (B) to a unit step 
ioe. 
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EXAMPLE II. System's response (A) 
Seven Poles and Two Zeros 
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step input. 
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EXAMPLE II. System's response (A) and the 
| Four Poles and Three Zeros 
model's response (B) to a unit 


step input. 


Figure III.34. 
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eeogure I11.35. EXAMPLE II. System's response (A) and the 
Five Poles and Three Zeros 


model's response (B) to a unit 
step input. 
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Figure III.36. EXAMPLE II. System's response (A) and the 
Six Poles and Three Zeros 
model's response (B) to a 
unit step input. 


vias: 





384 x 107 





aS) = 5 
s/+43259+626708°+ 36159005 44+75114000s34+553920000s-... 


. .+1443200000s+384x10!’ (III.17) 
Ome in factorized form 


384 x 107 
Gis)= 





(III.18) 
(s2+2s+10) (st10) (st+20) (s+80) (st120) (s+200) 


The response of this system to a unit step was com- 
puted from 0 to 8.4 seconds and 700 samples of this response 
(at intervals of 0.012 seconds) were used for the determina- 


ren Of optimum pth 


-order models by minimizing the objective 
function specified in Chapter II.B.3. 

It was decided to obtain all the low-order models of 
the seventh-order system described by Eq. (III.17) following 
the same technique as lec I and II. First obtaining a 
second-order model with no zeros. Having found the optimum 
parameters using the computer programme, the order is then 
increased by one and a new model is selected and determined. 
When the sixth-order model is determined the number of zeros 
is also increased by one and new models are found. In this 
way the search is completed when the six poles and three 


zeros model is determined. 


The main features of the step response are given 


below: 
HiMento reach Lirst oOveRshoot 2... «ss ..1.18 seconds 
Maximum overshoot ....... Re oO Ie sare oe ote os 30% 
Peecaddy-cleatke VaALUC “4s ges 66 escetaee ens a eter ere 6 i 
Dame ODO! ai ecse ls cis 6 eters Sree tee iw. oe vane eee ene 0 
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2. The Model Response 
The desired model response was represented by two 
dominant complex conjugated roots and a number of real poles 
depending on the model's order. 
From the curves of the step-response of a second 
order system with no finite zeros and the above features, 


starting parameters for the second order-model were selected 


as: 
0} = c¢ = 0.3 
5 = Wy = oD 
past; = 8.4 seconds. In the same way using the universal 


curves of the second-order linear system step response 
characteristic, reasonable bounds were chosen as: 

0.1l<€a,<0.55 

(ILS 

1.5€05<6. 
mipordcr to set constraints on the free parameters (0,05) 
for the determination of the second-order model, which will 
be starting parameter values (Chapter II.C) of the increasing 
order models. 

The state equations of the system are written 
ferectly from Eq. (III.17). 


The error criterion defined by Eq. (III.18) is 


minimized by the computer subroutine. 
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3. The Second-Order Model 

The state equations can be written as Eq. (III.4). 

The Bode gain was kept constant with no steady- 
state error between both responses (system and model). 

Constraints were set on the free parameters as 
indicated in inequalities (TIII.19). 

The optimum parameter values and minimum error 
criterion are tabulated in Table LEE. LI and the aaa 
III.37 shows a plot of the error criterion (J) value. 

4. Models 

As was done in Examples I and II, all the different 
order models ranging from the two poles and no zero to the 
Six poles and three zero were determined. 

Also as a basis of comparison, the seven poles no 
zeros model was determined; the optimum parameter values 
for this model are very close to the real parameter values 
of the seventh-order test system, and the value of the 
performance index (J) is the smallest of all (really it 
would be zero but for the limitations on computer accuracy). 

ine wells TIE. 11 te 11T.14 are shew the different 
sets of free parameter values for each of the optimum 
Specific-order models and the corresponding error criterion 
values. 

Plots showing the variation of J versus the number 
@Gimepoles of the model are given in Figs. Herr) cota Cleeve irene ve 

In order to get a basis of comparison between models 


meme resultant values of the cost function (J) for all of 
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TABLE III.11. EXAMPLE III. Optimum models with no zeros. 
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MABEE £ET .i4. EXAMPLE III. Optimum model with 
three zeros. 
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them are tabulated in Table III.15. Figures III.39 to 
ITI.49 show the transient responses of both the system and 
_ the reduced model for different pole and zero values. 

5. Remarks 

Some facts can be pointed out looking at Tables 
Mer! £6 ©LIT.15 and at Figs. III.37 and II1I.38, such as: 

a. The second-order models (no zero and one zero) 
do not appear to be suitable. 

b. A model which gives a minimum value of the 
error criteria is the six poles one zero model, although 
any model in the range from four to six poles (and even 
the third-order model) give small values of the error 
Srateria. 

c. As the order of the model is increased the 
locations of optimum poles values approaches the real 
values. Since the error criterion remains almost the same 
in the range from four to six poles, the poles located far 
away contribute very little to the general transient re- 
sponse (performance of the system). 

ad. If it is desired to represent the system by a 
specific order model, the tables indicate the cost paid 
for the simplicity. Similar tables can be constructed for 


any specific problem. 


E. EXAMPLE IV 
1. General — 
It was decided to select the model of a real physical 


system in order to continue the investigation of the reduced 
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Figure III.46. EXAMPLE III. System's response (A) and the 
Four Poles and Two Zeros 
model's response (B) to a 
unit step input. 
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models for the given system. The system chosen was one 
Representing the control system of the pitch rate of a 
Supersonic aircraft, and was taken from Sinha and others 
[2]. Sinha selects the variable parameters in the system 
block diagram for reasonable pole~zero locations, con- 
Sistent with design description and system stability. 
With these parameters, the transfer function of the test 


system 1s given by 


Y(s) 375000 (s+0.08333) 
2 
R(s) s/74+83.64594+40925°4+70342544+85370S"+2814271s2.... 
MeO OS 7552201250 (Tia 1S) 


The roots of the characteristic polynomial are 
eee O24t7069Goe> =VWee752j313,445 ; —-32.06527 385805 
The response of this system to a unit step was 
Simulated and computed from 0 to 21 seconds and 700 samples 
faieatntcervals of 0.03 seconds) were used for the determin- 
ation of all possible 1th_order models (2-0-6 easel es 
zeros (0<m<3), by the same technique and minimizing the 
error criteria function defined in Chapter II.B as the in- 
tegral of the squares of the output errors with no error 


in steady-state (constraint imposed) response to step input. 


The main features of the step response are given 


below: 
tate tO reach £LlrSst OVeErSnoot uw... .. 2.9 seconds 
Maximum overshoot ........ See eee ae 8.6% 
SeCdGyveotabcemvalUG "2... sss « enero. < Oa 
Response at maximum overshoot ...... OR 2 Oise 
BSNS emt OPM grate <6: h-5) ais ec oe Sec Mies ote ee ale ae 1 second 


Because the step-response of the system has over- 
Sees pair of conjugate poles and (2-2) real poles were 
specified for the different models. 

The simple second-order model was determined as an 
approach for starting the study. The state equations of 
the model are 

Suita (t) ; x, (0)=0 
5 (Tee 23) 

X¥5(t) = 1.-a5x (t) ~ 20,09xX5(t) 7 %X,(0)=0 
where the free parameters a] and a7 represent the damping 
ratio and the natural frequency. 

The output of the model is 

ee) KG Lt) (ee 22) 

From Eq. (III.19) the state equations of the system 


can be written 


0 1 0 Mitts a6... 36-6 a 0 0 
0 0 fe ae re ee a 0 0 
“8 i So (E) te eel eet te 
“a, “a2 no Se ee ~a4 ali 
(LTLigZss 
vt) = K{0.0833 1 0 ‘ : Oj. eae) 


From the step response of second-order linear system with no 
zeros and taking into account the features given in Eq. 
(III.20) , good starting parameter values were selected as: 
es 6 = Oey 
15 = Wy = 2.5 (IIT .24) 
Ce 


21 seconds 
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A performance index which is a flUnceionmor ene 
deviation between the output of both system and model, is 
aemined aS in Chapter II.B. Minimization oi@eiis cose 
function with respect to a, and om yields the "best" second- 
order model. 

Equations (III.21) and (III.23) are integrated with 
respect to time to calculate the value of the error criterion 
at each step of the minimization process. The integration 
step size is chosen as 0.03 seconds, the same sample in- 
terval of the system. The same criterion on the Bode gain, 
steady-state error and starting parameter boundaries with 
flexibility to change them yields the results tabulated in 
Table III.16. The transfer function of the second-order 
model becomes: 

0.36886 
a>) oan (LiL. 2 59 
Soo oe eeStoweo 7 
and the pole locations: -1.1661 + 31.424. 

After the above second-order model was determined 
maenvarious models of third, fourth, fifth and sixth orders 
were obtained. The errors produced by the various models 
ere Shown in Table III.20 and are plotted in Fig. III.50. 
For further comparison between the reduced models a complete 
list of the optimum parameter values are tabulated in 
meebes [71.16 to III.19. 

Step responses of some models and the actual system 


mee shown in Figs. Iif.51 to IIL.58 on identical time Seatcee 


oF 








meen L[LLL.20. “Error criterion (Jx10°) for. Varleuc 
models in Example IV. 


It will be seen that most of the step responses of 
the Mecemined models are not a good approximation to the 
true response of the tested system. Larger overshoot and 
smaller settling time can be observed and a singular fact 
can be pointed out from the step response figures: the 
decaying part of the transient response was not achieved 
by the determined models having only a pair of complex 
conjugate poles and the others (2-2) poles restricted to 
be real. It is clear that the actual system has a small 
real pole which has not been identified. 

Looking at Tables L11.16 to IiL.19 is noticed thee 
the third pole (first real pole) of the different models 
is always greater than 5.2, no optimum value less than this 
value is obtained. The selected system has a real pole 
very close to the origin, p, = 0.092, and also has one zero, 
Zz, = 0.0833. It was thought that the effect on the transient 
response of this zero and pole would be minimum due to the 
fact that they are close together and the zero might cancel 
mene residue at the pole so that the contribution to the 


step-response would be negligible. Actually the pole close 
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TABLE III.16. EXAMPLE IV. Optimum models with no 
zeros. 





TABLE III.17.- EXAMPLE IV. Optimum models with one 
Zero. 
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TABLE III.18. EXAMPLE IV. Optimum models 
with two zeros. 
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TABLE III.19. EXAMPLE IV. Optimum models with 
three zeros. 
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Figure III.56. EXAMPLE IV. System's response (A) and the 
Four Poles and One Zero model's 
response (B) to a unit step 
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mO the origin appears toOsmaintain its predomimamecereoee 
mainly in the decaying part of the transient response and 
for that the determined models are not a good approximation. 

It was decided to impose on the program a constraint 
on the possible values of the third real pole in order to 
maintain its value in the proximity of the original system's 
value. 

The investigation of the reduced models for the con- 
trol system of the pitch rate of a supersonic aircraft was 
then repeated. 

The various models of second, third and fourth orders 
were obtained by the same technique as previous runs, using 
the same initial values for the complex poles. Besides 
constraining the third pole value to stay in the vicinity 
of its original value, in the models with one or more zeros 
a Similar constraint was also imposed on the first zero 
value. 

The optimum parameter values of the various new 
models obtained and the corresponding values of the perfor- 
mance index are shown in Table III.21. Step-responses of 
both original and lower order models are shown in Figs. 
moo to I11.65. 

It is worth noticing that the new models determined 
are much better approximations to the true system than the 
previous models. The cost function values are smaller and 
the third pole is close to the origin. 

As a final checking of the necessity of constraining 


also the first zero in the minimization program in order to 
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Figure III.59. EXAMPLE IV. System's response (A) and the 
Two Poles and One Zero model's 
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Figure III.60. EXAMPLE IV. System's response (A) and the 
Three Poles and One Zero model's 
response (B) to a unit step 
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Maintain its value in the proximity of the original system's 
value a new run was done. A new three poles and one zero 
model was determined setting constraint on the small pole 


Pmt not on the small zero. 


The optimum parameter values of the new model were: 


3 Poles | | . | | 


which compared with the model obtained constraining both 
















small pole and small zero (see Table III.21) does not appear 
to be much different. No constraint seems es be necessary 
on the small zero. Only seems mandatory to impose a con- 
straint on the small pole upper bound because the decaying 
part of the system's transient response. 
2. Remarks — 

Looking at the results the following comments should 
be noted: 

a. The error criterion (J) value at Table III.20 
are of the same order as the ones in Table III.5 (Example I) 
but the models are not a good approximation. The values of 
(J) at Table III.21 are much smaller and the models are a 
good approximation. It can be deduced that the cost function 
(J) is related mainly to the steady state final value which 
in Example I was 1.0 and in this example is 0.111. Selection 
of the desired model can be done taking into account this 


hact.. 


9 


b. The second-order model still is worst and does 
not appear to be suitable. 

c. The third and fourth order models with zeros 
achieve a very acceptable error criterion value. 

gd. A model which gives a minimum value of the per- 
formance index (J) is the four poles one zero model, al- 
though the three poles one zero and four poles two zeros 
give small value of (J). Again a "best" optimum model seems 
Suitable. 

e. The complex root values for the various models 
remain in avery small area. The first real pole and the 
first real zero remain in the proximity of the original ones. 
The system has one pole and one zero very close to the 
origin. It seems that in the cases in which the high-order 
system has singularities very close to the origin it is 
necessary to keep them in the low-order models. 

f. Selection of the desired model can be done for 
eeific required approximation depending on the desired 
simplicity, looking at the transient responses of both 
(original and approximated) and weighting the cost function 
values (J). 

g. The starting second-order model assumed gives 
good starting parameter values for the derivation of in- 


creasing order models. 


20 





IV. CONCLUSIONS 


The investigation presented can be considered as another 
approach to find the best low-order linear constant system 
which approximates the given high-order system. 

It is based on the exhaustive use of the computer to 
estimate the free parameters which locate the roots of the 
model for which the integral of the squares of the errors 
is Minimized. (The error is defined to be the difference 
between the response of the actual system and that of the 
model. The integral is evaluated between 0 and a selected 
‘final time.) 

The description of the actual system dynamics need not 
necessarly be known. The case has been investigated in 
which the input-output data measured at discrete instants 
of time is known. 

In Chapter III four examples were investigated to de- 
termine all the optimum models whose order varies from the 
second-order with no finite zeros to seventh-order with 
three real zeros. A complete set of graphs showing the 
Variation of the error criteria value with respect to the 
number of zeros and poles of the model and all different 
pole and zero locations on the s-plane of the models were 
determined. 

The variety of tables and figures has been obtained to 
enable the analyst and/or engineer to make a rapid and 


Suitable choice of the order of the model weighting the 


eZ A 





eost function (J). Gamwanalysisc has been presented for 
evaluating the effects of such attempts in the various 
transient responses. It is felt that a new insight has been 
gained in the cost paid for the simplicity of the model and 
in the accuracy of the transient response of the model re- 
imereed to the numerical value of the err@r riterion, in 
order to get an acceptable response. 

The following remarks can be stated: 

1. The most common methods of modeling higher-order 
systems by making a second-order model approximation do not 
appear to be suitable for an error criterion value which 
Give acceptable approximation according to the simplicity 
of the model. 

With at least three poles and one zero models can be 
obtained which give a very good approximation. 

2. A good approach for starting the study when the 
step-response of the system has an overshoot, was the de- 
termination of a pair of complex roots for the model derived 
from the curves of the step response of second-order linear 
system. To do this one takes into account the most common 
features of the step-response of the system. 

When the transient response of the system shows the 
existence of a pole close to the origin, it appears to be 
mandatory to keep this singularity also in the lower order 
model. ‘ 

3. It is possible, in effect, to weight the desired 


Simplicity of the model versus selected error criterion 
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value. A "best" optimum low-order model which gives the 
minimum of all cost function values seems feasible. 

4. The cost function value drops down very fast achiev- 
ing a very acceptable value after the third or fourth order 
models are obtained. Then as the order of the model is in- 
creased the error criterion value varies very little and 
remains almost unchanged. So adding poles to the model - 
increasing its complexity or losing its simplicity - is not 
going to minimize the cost function value which remains in 
a very small area, i.e., the magnitude of the cost is 
essentially unchanged by the addition of poles and zeros, 
and furthermore keeps a very acceptable value. 

Increasing the order of the model is not justified by 
the results because the price paid is high in comparison with 
the small improvement in the error criterion value. Under 
such circumstances the third or fourth order models seems to 
accomplish the characteristics of a good model. The decision 
in the choice of the reduced approximated model is done more 
easily knowing this fact in the cases in which limitations 
on the maximum order of the model or sufficiency of the 
resultant error (J) are real constraints. 

5. The computer subroutine optimizes the selected model 
With respect to a specific error criterion. The user has to 
Give the starting parameter values and it was seen how 
fundamental is this selection of values to achieve the 
optimum minimum rvor criterion. Limitations arise from 


this fact and from the convergence properties of the 


algorithm which this subroutine uses. Improvement in 
efficiency should be possible by using a minimization 
program with known good convergence properties. 

6. In Example IV was noted that in all cases the small 
mole and small zero did not go to the constraint limit, but 
they found a value within the constrained range. This seems 
to indicate that a local minimum does exist but was missed 
in the unconstrained searchs, probably because the minimiza- 
tion program used too large an increment. 

As was stated in point 5, a good computer program will 


improve largely the efficiency of the search of the model. 
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SAMPLE PROGRAM FOR EXAMPLE — 
OPTIMUM FOUR POLES AND ONE ZERO MODEL 
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